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Abstract. The Pauli exclusion principle (PEP) has been tested for nucleons {n,p) in ^^C and ^^O nuclei, 
using the results of background measurements with the prototype of the Borexino detector, the Counting 
Test Facility (CTF). The approach consisted of a search for 7, n, p and/or a's emitted in a non-Paulian 
transition of IP- shell nucleons to the filled 151/2 shell in nuclei. Similarly, the Pauli-forbidden /3 decay 
processes were searched for. Due to the extremely low background and the large mass (4.2 tons) of the 
CTF detector, the following most stringent up-to-date experimental bounds on PEP violating transitions 

of nucleons have been established: tC^C -^^^ C + 7) > 2.1 • 10^^ y t^^C ^" B + p) > 5.0 ■ 10^** y 

rC^CC'O) ^" CC'd) +n)> 3.7 ■ 10^^ y tC^C ^"^ Be + a) > 6.1 • 10^^ y rC^C ^^^ N + e' + u,) > 

7.6 ■ 10^^ y and tC'^C ^^^ B + e+ + u^) > 7.7 • 10^^ y aU at 90% C.L. 

Key words. Pauli exclusion principle - low background measurements 

PACS. 1 1.30.-J, 24.80.+y, 23.20.-g, 27.20.+n 
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1 Introduction 

The exclusion principle was formulated by W.Pauli in 1925 
and in its original form postulated that only one electron 
with definite spin orientation can occupy each of the al- 
lowed Bohr orbits in an atom. In this way PEP explains 
the regularities of the Periodic Table and atomic spectra. 
In modern Quantum Field Theory (QFT), the PEP ap- 
pears automatically for systems of identical fermions as a 
result of the anti-commutativity of the fermion creation 
and annihilation operators. Violation of the PEP, as of 
the nonconservation of electric charge, would contradict 
modern quantum field theory. 

PEP has fundamental importance, but it was not ex- 
tensively studied experimentally for 15 years until the elec- 
tron stability was tested. Goldhaber pointed out that the 
same experimental data which were used to set a limit on 
the lifetime of the electron can be used to test the validity 
of the PEP for atomic electrons |Tj. Pioneering experi- 
ments were performed by Reines and Sobel by searching 
for X-rays emitted in the transition of an L-shell electron 
to the filled K-shell in an atom 1 , and by Logan and 
Ljubicic, who searched for 7-quanta emitted in a PEP- 
forbidden transition of nucleons in nuclei p . 

In 1980 Amado and Primakoff pointed out that in the 
framework of QFT, these PEP- violating transitions are 
forbidden even if PEP-violation takes place .3,. Later a 
theoretical models describing a violation of PEP were con- 
structed in 0-jni, but it was found that even small PEP- 
violation leads to negative probabilities for some processes 
|Zj . Critical studies of the possible violation of PEP have 
been done both theoretically and experimentally by Okun 

MM 

One of the methods of testing PEP is the search for 
atoms or nuclei in a non-Paulian state; another is the 
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search for the prompt radiation accompanying non-Paulian 
transitions. 

Violation of PEP in the nucleon system has been stud- 
ied by searching for the non-Paulian transitions with 7- 
[21,[Tni,III], p-ini,|I31 and n-ini emission, non-Paulian 
Z?"*", /3~- decays ^HliCIJ and in nuclear (p,p),(p, a)-reactions 



on 



^C [TSj. 



The sensitivity of the forbidden transitions method is 
defined by the mass of the detector and by the background 
level of detector. The extremely low background level and 
the large mass of the CTF allowed setting new limits on 
the electron, neutrino and nucleon stability and neutrino 
electromagnetic properties ^T] - [201 ■ The approach used 
in the search for nucleon and dinucleon disappearance |19| 
is close to the one used in the present letter to search for 
PEP violation. 



2 Experimental set-up and measurements 

2.1 Brief description of the CTF 

Borexino, a real-time 300 ton detector for low-energy neu- 
trino spectroscopy, is nearing completion in the Gran Sasso 
Underground Laboratory (see [21] and refs. therein). The 
main goal of the detector is the measurement of the ^Be so- 
lar neutrino flux via (z/, e)- scattering in an ultra-pure liq- 
uid scintillator, but several other basic questions in astro- 
and particle physics will also be addressed. 

CTF, installed in the Gran Sasso underground labo- 
ratory, is a prototype of the Borexino detector. Detailed 
reports on the CTF results were published elsewhere|21|- 
|23j . and only the main characteristics of the set-up are 
outlined here. 

The CTF consists of an external cylindrical water tank 
(011x10 m; wlOOO t of water) serving as passive shield- 
ing for 4.2 m'^ of liquid scintillator (LS) contained in a 
transparent nylon spherical vessel of 02.0 m. High pu- 
rity water with a radio-purity of «10~^'* g/g (U/Th), 
wl0~^2 g/g (K) and < 2/iBq/Z for 222Rn is used for the 
shielding. The LS was purified to the level of ~10^^® g/g 
in U/Th contamination. 

We analyze here the data of the second phase of the 
CTF detector (CTF2). The liquid scintiUator used at this 
stage was a phenylxylylethane (PXE, CieHig) with p- 
diphenylbenzene (para-terphenyl) as a primary wavelength 
shifter at a concentration of 2 g/l, along with a secondary 
wavelength shifter l,4-bis-(2-methylstyrol)-benzene (bis- 
MSB) at 20 uig/l l24j. The density of the scintiUator is 
0.99 kg/ 1. The scintillator principal de-excitation time is 
less than 5 ns, which permits good position reconstruc- 
tion. In the CTF2 an additional nylon screen between the 
scintillator vessel and PMTs was installed, acting as a bar- 
rier against penetration of external radon. The water vol- 
ume of the CTF2 detector is instumented with a Cerenkov 
muon detector (muon veto system). 

The scintillation light is collected with 100 large photo- 
tubes (PMTs) fixed to a 7- m diameter support structure 
placed inside the water tank. The PMTs are fitted with 
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Fig. 1. Occupation of energy levels by protons and neutrons 
for the ^ C ground state in a simple shell model. Schemes of 
non-Paulian transitions of nucleons from the P-shell to the 
filled 5'-shell: a) with 7-, n-, p- and a-emission; b) with /3^-, 
/3~- emission. 



light concentrators which provide a total optical coverage 
of 21%. 

For each event the charge and time of every PMT hit 
are recorded. Each electronics channel is supported by an 
auxiliary channel used to record events coming within a 
time window of 8.2 ms after the trigger, which allows tag- 
ging of fast time-correlated events with a decrease of the 
overall dead time of the detector. For longer delays, the 
computer clock is used, providing an accuracy of «50 ms. 
Event parameters measured in the CTF2 include the total 
charge collected by the PMTs during the 0-500 ns win- 
dow, used to determine an event's energy; the charge in 
the 'tail' of the pulse (48-548 ns) which is used to dis- 
tinguish between a and f3 events through the pulse shape 
discrimination method; PMT timing, used to reconstruct 
the event's position; and the time elapsed between sequen- 
tial events, used to tag time-correlated events. 



2.2 Detector calibration 

The energy of an event in the CTF detector is measured 
using the total collected charge from all PMT's. In a sim- 
ple approach, the response of the detector is assumed to 
be linear with respect to the energy released in the scintil- 
lator. The coefficient A linking the event energy and the 
total collected charge is called the light yield (or photo- 
electron yield). Practically, the light yield for electrons can 
be considered linear in energy only above ~ 1 MeV. At 
low energies the phenomenon of "ionization quenching" 



violates the linear dependence of the light yield versus en- 
ergy. The deviations from the linearity can be taken into 
account by the ionization deficit function /(fcs, E), where 
ks is the empirical Birks' constant |2SI- For the calculation 
of the ionization quenching effect for the PXE scintillator, 
we used the KB program from the CPC library |26j . 

The ionization quenching effect leads to a shift in the 
position of the total absorption peak for 7's on the energy 
scale calibrated using electrons. In fact, the position of 
the 1461 keV '^^K 7 in the CTF2 data corresponds to 
1360 keV of energy deposited by an electron 18^. 

The energy calibration derived from the ^^C /3-spectrum 
gives A = 3.72±0.08 photoelectrons/(MeV x PMT) for 
high energy electrons depositing their energy at the de- 
tector's center. ^ 

The detector energy and spatial resolution were stud- 
ied with radioactive sources placed at different positions 
inside the active volume of the CTF2. A typical spatial la 
resolution is 10 cm at 1 MeV. The studies showed also that 
the total charge response of the detector can be approxi- 
mated by a Gaussian. For energies E >lMeV (which are 
of interest here) , the relative resolution can be expressed 
as as/E = v'S.S keV/E + 2.3 ■ IQ-^ ^ for events uni- 
formly distributed over the detector's volume. 

The energy dependence on the collected charge be- 
comes non-linear for energies E > 5 MeV because of the 
saturation of the ADCs used. In this region we are using 
only the fact of whether or not candidate events are ob- 
served, hence the mentioned nonlinearity doesn't influence 
the result of the analysis. 

More details on the energy and spatial resolutions of 
the CTF and ionization quenching for electrons, 7 quanta 
and a particles were reported in [TTj . [THj . [?7| . 



2.3 Muon veto 

The CTF2 was equipped with a water Cherenkov muon 
veto system. It consists of 2 concentric rings of 8 PMTs 
each, installed at the bottom of the tank. The radii of the 
rings are 2.4 and 4.8 m. Muon veto PMTs look upward 
and have no light concentrators. The muon veto system 
was optimized in order to have a negligible probability 
of registering the scintillation events in the 250-800 keV 
^Be neutrino energy region. The behaviour of the muon 
veto has been specially studied at higher energies J^ . Ex- 
perimental measurements with a radioactive source (chain 
of 222Rn) |2H] gave the value t]{E) = {1±0.2)% in the 1.8- 
2.0 MeV region for the probability ri{E) of identification 
of a scintillation event with energy E in the LS as a muon. 
The energy dependence of ri{E) was also calculated by a 
ray-tracing Monte Carlo method accounting for specific 



^ No measurements with high energy monoenergetic elec- 
trons are available for the PXE scintillator. This is just conve- 
nient interpolation of the value obtained fitting ^*C spectrum, 
which allows to separate energy dependent part using ioniza- 
tion deficit function f{kB,E). The registered amount of light 
at any energy can be calculated as Y{E) — A ■ f{kB,E). For 
1 Mev electron Y{1 MeV)=3.54±0.08 p.e./(MeV x PMT). 
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features of the light propagation in the CTF2 which are 
detailed in |22|. The calculated function was adjusted to 
reproduce correctly the experimental measurements with 
the ^^^Rn source. 



3 Data analysis 

3.1 Theoretical considerations 

The non-Paulian transitions were searched for in nuclei 
of ^^G contained in the scintillator and ^®0 in the wa- 
ter shield of the CTF2 detector, respectively. The nu- 
cleon level scheme of ^^C in a simple shell model is shown 
in Fig.l. The nucleon binding energies for the light nu- 
clei ("'^^C, "'^^O and others) were measured while study- 
ing (p, 2p) and (p, np) proton scattering reactions with 1 
GeV energy |25]. The measured values for 15*1/2 a-nd 1^3/2 
shells |2n! together with n, p and a separation energies [30] 
are shown in table 1. For example, the measured values for 
the lSi/2 shell of ^^C are Er^{lSl/2,^^ C) = 36.3±0.6 MeV 
and Ep{lSi/2,^'^ C) = 33.9 ± 0.9 MeV. These values sig- 
nificantly differ from value Ep{lSu2,^^ C) = 39 ± 1 MeV 
extracted from (e, ep)-scattering |31| . 



Table 1. The separation energy Sp, Sn, Sa |3()| . the nucleon 
binding energy (with errors) of the IP3/2 and 15*1/2 shells |29| . 
and the nuclear binding energy Et fkeVlp^. 
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The transition of a nucleon from the P^hell to the 
filled S-shell will result in excited nuclei ^^C. The exci- 
tation energy corresponds to the difference of the bind- 
ing energies of nucleons on S- and P-shells. As one can 
see from the table, the energy release in the non-Paulian 
transitions in ^^C and ^^O is comparable with separation 
energies Sp, Sn, Sa', hence, together with emission of 7- 
quanta, the emission of n, p and a is possible. Because of 
the uncertainties in the values of Eg'^ , the prediction of 
the branching ratio for the emission in each of the above 
mentioned channels has a poor significance. For the case 
of the nucleon and dinucleon invisible decay in nuclei, the 
branching ratio and spectra of the emitted particles were 
considered in |32) . In the present paper we give the sepa- 
rate limits on the probabilities for each of the possible re- 
actions. The weak processes with a violation of the PEP 
(/3+,/3~-decays) ^J, ^3] with a non-Paulian nucleon in 
the final state (on 15*1/2 shell) are considered as well. 
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Fig. 2. Background energy spectra of the 4.2 ton Borexino 
CTF2 detector measured over 29.1 days. From top to bottom: 
(1) the raw spectrum; (2) with muon veto cut; (3) non-muon 
events inside the radius R <100 cm; (4) pairs of correlated 
events (with time interval At <8.2 ms between signals) are 
removed; (5) a/ (3 discrimination is applied to eliminate any 
contribution from a particles. In the inset, the simulated re- 
sponse function for external '"'K 7's is shown together with the 
experimental data. 



3.2 Data selection 

The candidate events, relevant for our studies, have to 
satisfy the following criteria: (1) the event should occur in 
the volume of the detector and must not be accompanied 
by the muon veto tag; the probability of detecting high 
energy events in LS has to be taken into account; (2) it 
should be single (not followed by a time-correlated event) 
except in the case of neutron emission; (3) its pulse shape 
must correspond to that of events caused by 7, /3 or a 
particles depending on the specific channel under study. 

The experimental energy spectrum in CTF2, accumu- 
lated during 29.1 days of measurements (live time), is 
shown in fig. 2. The trigger level was set at 21 fired PMT 
in a 30 ns window; the total count rate at this threshold 
was 0.5 s~^. The raw spectrum is presented on the top. 
The peak at 1.46 MeV, present in all spectra, is due to 
7-quanta from ^°K decays outside the scintillator, mainly 
in the ropes supporting the nylon sphere. The peak-like 
structure at ^--^6.2 MeV is caused by saturation of the 
electronics by high-energy events. 

The second spectrum is obtained by applying the muon 
cut, which suppressed the background rate by up to two 
orders of magnitude, depending on the energy region. No 
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events with energy higher than 4.5 MeV passed this cut. 
In the next stage of the data selection we apphed a cut on 
the reconstructed radius. We used a R <100 cm (radius 
of the inner vessel) cut aiming to reduce significantly the 
surface background events (mainly due to the '^''K decays 
outside the inner vessel) and leave the events uniformly 
distributed over the detector volume. The efficiency of the 
cut has been studied with MC simulation and lies in the 
range of ej^ = 0.76 — 0.80 in the energy region 1-2 MeV. 
The time-correlated events (occurring in the time window 
At < 8.2 ms) were also removed (spectrum 4). Suppression 
of non-correlated events is negligible (0.4%) due to low 
count rate. Additional a//3 discrimination |221 was applied 
to eliminate contribution from a particles (spectrum 5 in 
fig. 2). The loss of /3-particles for a identification efficiency 
85% is less than 2% for the 1 MeV energy region ^^. 

The selection and treatment of data (spatial cuts, anal- 
ysis of an event's pulse shape to distinguish between elec- 
trons and a particles, suppression of external background 
by the muon veto system, etc.) is similar to that in ref. 

[13,1111, Hi, EDI 



3.3 Simulation of the response functions 

Due to the complex phenomena of light propagation in a 
large volume scintillator detector, the precise modeling of 
the detector response is a complicated task. Among the 
problems, it is worth mentioning the wavelength depen- 
dence of the processes involved in light propagation; re- 
flection/refraction on the scintillator/water interface; the 
light reflection on the concentrators; etc. |2S|- The non- 
spherical shape of the inner vessel, deformed by the sup- 
porting strings, is an additional source of uncertainty. The 
need to follow each of the 12000 photons emitted per 1 
MeV electron event makes tracing MC code very slow. 

We developed a fast reliable code, based on the mea- 
surements with the detector. The perfect sets of data for 
the code tuning are the ^^C /3— decay data and the easily 
identifled a's from the radon decay in the scintillator vol- 
ume. The code has two parts: the electron-gamma shower 
simulation (EG code) and the simulation of the registered 
charge and position (REG code). The EG code generates 
a random- position event with a random initial direction 
(for 7's) and follows the gamma- electron shower using the 
EGS-4 codejnSJ. The low-energy e and a are not propa- 
gated in the program and are considered to be point-like, 
with the position at the initial coordinates. 

The mean registered charge corresponding to the elec- 
tron's energy Ee is calculated by 



Qe = A-E,-f{kB,E,)-fR{r), 



(1) 



where fnir) is a radial factor taking into account the de- 
pendence of the registered charge on the distance from the 
detector's center, and /(fcs, Ee) is the quenching factor for 
electrons. The method used to obtain /_R(r) is described 
in IS3|. 

From the analysis of the PXE data, the quenching fac- 
tor fc^ = (1.5±0.1)-10~^ was found to satisfy experimental 



data jTHj. The value is in agreement with the high statis- 
tics fit of the ^^C /3— spectrum. The presence of the strong 
7 line of 1.46 MeV in the CTF2 data was used to check 
the method: first, the quenching factor was extracted from 
the ^'^C /3— spectrum, and then the ''"K 7's were simulated. 
The position of the peak in the model agreed with the real 
data to within 1% accuracy. 

The mean registered charge corresponding to the a of 
energy Ea is calculated by 



Qa=A-E^-UiE^)-fR{r), 



(2) 



where /q(£'q) is the quenching factor for a's. The fol- 
lowing approximation of the quenching iactoi fa{Ea) was 
found on the basis of laboratory measurements for a scin- 
tillator based on pseudocumene (PC): 



/r"(i^a) 



1 



a — b ■ Ea 



(3) 



with a — 20.4 and b — 1.3. The measurements of the 
fa{Ea) for PXE were performed in laboratory [33] and 
analyzing delayed spectra of the CTF2 |21] . It was found 
that an a-particle with energy 7.69 MeV is quenched to an 
equivalent /3-energy of 950±12 keV. Other reference points 
were found using the peaks corresponding to 3 a-particle 
of 5.3, 5.49 and 6.02 MeV correspondingly. Using the same 
form of approximation as for PC, we found a = 16.2 and 
fe = 1.1 for the PXE scintillator. 

The 7's were propagated using EGS-4 code j^Hl- As 
soon as an electron of energy Ee is to appear inside the 
scintillator, the corresponding charge is calculated: 



AQ,^A-Ee,-f{kB,EeJ-fB.in) 



(4) 



total mean collected charge is defined when the 7 is dis- 
carded by the EG code, summing individual deposits: 



The weighted position is assigned to the final 7: 



(5) 



(6) 



where AQi and Xi are the charge deposited for the i*'' 
electron at the position {xi,yi, Zi). The analogous rule is 
applied for the y^, and z^ coordinates. 

In the next step a random charge is generated in ac- 
cordance to the normal distribution with a mean value 
oi Q = Yl ^Q S'li'i with variance erg = \/(l -t-I^r) • Q. 
The instrumental parameter vi is the relative variance of 
the single photoelectron charge response averaged over all 
PMTs of the detector. It was defined independently from 
the measurements with radon source inserted in the de- 
tector and from averaging the relative variances of the 
single photoelectron response obtained during the accep- 
tance tests [57|. Both method give vi — 0.34 ± 0.01. 

Finally, the radial reconstruction is simulated taking 
into account energy dependence of the reconstruction pre- 
cision. It is assumed that the reconstruction precision is 
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defined by the number of PMTs fired in an event and tliat 
reconstruction precision doesn't depend on the position. 
These tvifo facts are in agreement vifith the measurements 
using the artificial radon source inserted in the CTFl and 
CTF2 detectors [22,. 

The fit of the radial distribution of the a-particle events 
with energy Ea=7.69 MeV (equivalent electron energy 
Ee=950 keV) gives an = 13.8 cm. If we assume that the 
reconstruction precision is defined by the mean number N 
of fired channels, then the aR{E) for an event of energy 
E is: 



10000 - 



TRiE) = aR{950 keV) 



IN {950 keV) 

< N{E) > ' 



(7) 



where mean number of fired PMTs for E=950 keV is 
7V(950 keV) = 91 (of the total 100). The number of the 
fired channels N{E) was simulated for every event assum- 
ing a Poisson distribution of photoelectrons registered on 
each PMT. 



4 Results 

4.1 Limits on non-Paulian transitions in ^^C and ^^O 
with emission of 7. 

As follows from table 1, the energy difference for the nu- 
cleon transition from the shell IP3/2 to the shell lS'1/2 is 



~ 17.5 MeV for ^^C. The response functions of the CTF2 
to the 7 of this energy were simulated by the MC methods 
described in the previous subsection. The energy differ- 
ence for the same transition in the case of ^^O corresponds 
to ~21 MeV. The uniformly distributed 7's of this energy 
were simulated in the 1 m- thick layer of water surround- 
ing the scintillator. Both response functions are shown in 
Fig. 3 before and after the muon veto suppression. 

The limit on the probability of transitions ^^C^^^ C+ 
7 and ^^O^^ + 7 violating the PEP are based on 
the experimental fact of observing no events with energy 
higher than 4.5 MeV passing muon veto cut. The lower 
limit on PEP violating transitions of nucleons from P- 
shell to the occupied liS'i/2-shell was obtained using the 
formula 

T>eAE—^ T, (8) 

where eae is the efficiency of registering an event in the 
energy interval AE^ iV^v is the number of nuclei under 
consideration, N^ is the number of nucleons (n and/or 
p) in the nuclei for which the non-Paulian transitions are 
possible, T is the total time of measurements, and Sum is 
the upper limit on the number of candidate events regis- 
tered in the AE energy interval and corresponding to the 
chosen confidence level. 

The efficiency of 17.5 MeV 7 detection eae = 4.3- 10"^ 
was determined in a MC simulation, taking into account 
the suppression of the high energy events by the muon 
veto system (fig. 3). The number of ^^C target nuclei in 
4.17 tonnes of liquid scintillator based on PXE is Nn = 
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Fig. 3. The expected response functions of the detector for 
^^C ~*^^ C + "f decays in the liquid scintillator and ^^O -^^^ 
O + "/ decays in the water shield before and after muon veto 
suppression are shown. 



1.89 • 10^^ (taking into account the isotopic abundance of 
^^C). The number of nucleons on the P-shell is Nn = 8, 
the total data taking time is T = 0.080 y, and the upper 
limit on the number of candidate events is Sum = 2.44 
with 90% C.L. in accordance with the Feldman-Cousins 
procedure |3Bj, recommended by the Particle Data Group. 
The ^^O nucleus has 8 nucleons on its IP3/2 and 4 
nucleons on its IP1/2 shell. The values of the binding 
energy of the nucleons on lPi/2-shell are Ep{lIj/2) = 
13.4±0.4 MeV and £;„(lPi/2) = 16.2±0.3 MeV ^. The 
values oisAE were calculated for E^ = 21.8 MeV, 26 MeV 
(1^3/2 -^ ^Si/2,^Pi/2 -^ ^Si/2 transitions) and for the 
two 7-quanta in the cascade £'^ = 21 + 5 MeV. These val- 
ues are 5.7- 10~^, 5.4-10"'^, and 2.2 -10^^ correspondingly. 
Because of the unknown branching ratio, the worst pos- 
sible total efficiency eae — 5.6 • 10"'^ was adopted. The 
number of target ^^O nuclei in the 1 meter thick layer of 
water shielding is N]\f — 9.8 • 10^^ and the upper limit on 
the number of the candidate events corresponding to the 
90% c.l. is the same as in the previous case, Sum = 2.44. 
The limits obtained using the cited numbers are: 






.12 



,16 



C-1-7) >2.1-10^^y 



-,27 



O-f 7) > 2.1- 10^' y, 



(9) 

(10) 



with a combined Hmit of t > 4.2 • 10^^ y for the 90% c.l. 
This result is stronger than the ones obtained with the 
NEMO-2 detector t{^^C ^^^ q^^^ > 4.2.1024 y [TTj, and 
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the Kamiokande detector t{^^0 



,16 



+ 7) > 2.7-lO^Uj 



4.2 Limits on non-Paulian transitions in ^^C with 



proton emission ^^C 



,11 



B 



P- 



Energy released in these transitions is the difference be- 
tween the binding energies of the final and initial nuclei: 



Q(i2C7 ->" B+p) = Af(i2C) - M("B) 



(11) 



with the evident notations. The binding energy of the 
non-Paulian nuclei with 3 neutrons Eb{^^Bn) or 3 pro- 
tons EbQ-^Bp) on the S-shell can be evaluated considering 
the binding energy Eb{}^B) and the difference between 
the binding energies of nucleons on the S-shell -En, p (5*1/2) 
and the binding energy of the last nucleon Sn,p(^^B): 

EbC^Br^^p) ~ EbC'B) + E„^p{lSi/2) - Sn^pC^B). (12) 

Using the data of Table 1, one can obtain (5(^^C— >^^ 

Bp+p) = 6.3 MeV and Q{^^C^^'^ B^ + p) = 7.8 MeV. 
Taking into account the recoil energy of the nuclei and 
experimental errors of £'„,p(5i/2) from table 2, the energy 
of the proton released in these non-Paulian transitions is 
Ep = 5.8(7.2) ± 1.0 MeV. 

The light yield for the protons in the range of 0.6- 
6.0 MeV was measured for the NE213 scintillator using 
recoil protons from the {n,p) elastic scattering ^3. The 
measured data were approximated by the formula relating 
energy release of protons Ep and electrons Eg : 



Eg = 0.034 • Ei, + 0.311 • E„ - 0.109 



(13) 



The hght yield for a proton with energy Ep=5.8{7.2) MeV 
corresponds to an electron energy of Ee=2.8{3.9)± 0.5 MeV 
It means that the proton peak can be found in the energy 
interval 2.0-4.7 MeV with 90% probabihty. The uncer- 
tainty of the peak position is few times higher than energy 
resolution of CTF2 (crB=130 keV for Ee = 2 MeV) and 
covers errors due to using NE213 data instead of that for 
PXE. 

To establish limits on the probability of these non- 
Paulian transitions in ^^C, we use the formula ^. Be- 
cause of uncertainty in the p peak position, Sum was de- 
termined using a very conservative approach: it was de- 
fined as the number of events N inside the 2<te window 
(£ab=0.68) which can be excluded at a given confidence 
level {N+1.28VN for 90% c.l.). This procedure was used 
for the wide energy interval 2.0-4.7 MeV. The maximum 
value of Slim = 130 at 90% c.l. (and the least stringent 
limit on life-time) was obtained for the energy interval 2.0- 
2.26 MeV. The lower limit on the life-time was found from 
formula JHJ taking into account the efficiency of radial cut 
6^=0.8: 



This result is stronger than ones obtained with the 300 kg 
Nal ELEGANT V detector ri'^^Na,^'^'' I ^^^ Ne,^^^Te + 
p) > 1.7 • 10^5 y (90% c.l.) for protons with £;p>18 MeV, 
and with the 100 kg Nal DAMA detector ri'^^Na,^'^'^ I ->22 
Ne,^'^'^fe+p) > (7- 9)- 1024 y (90% C.L) for protons with 
^p>10 MeV. 



4.3 Limits on non-Paulian transitions in ^^C with 
a-particle emission ^^C^^ Be + a. 

The binding energy of an a-particle in ^^C nuclei is as low 
as 7.4 MeV. The energy released in the transition is the 
difference between the binding energies of the final and 
initial nuclei: 

QC^C ^^B'e + a)^ -EtC^C) + Et^Be) + E^He). 

(15) 
The binding energy of nucleons on the S-shell of ^Be 
can be obtained using experimental values En,p{lSi/2) 
for the isotope ^Be. The binding energies for the non- 
Paulian nuclei ^i3e„ and ^Bcp calculated thus give values 
g ~ 2.9 ± 0.9 MeV and Q ~ 3.0 ± 0.6, respectively. As 
the result, the a-particles from the decay can be found 
in the energy interval 1.0 - 3.0 MeV with 90% probabil- 
ity. In accordance with (3), the light yield for an a with 
energy between 1.0-3.0 MeV corresponds to an electron 
in the energy range 70 - 230 keV. The CTF2 efficiency 
of a/ f3 discrimination was not studied in this energy re- 
gion and a/(3 selection was not used for reaction (15). 
The dominant part of the background in this range is the 
/3-activity of ^''C. For the energy window (230 keVicr^;, 
cr_E=30 keV) the value Sum is 3400 at 90% c.l (spectrum 4 
on fig. 2) . Taking into account the efhciency of the radial 
cut eii;=0.67, the lower limit on lifetime for decay (15) is 
T >1.6-102^ y. Our results on electron stability, obtained 
on the same experimental data, can be used to set stronger 
limit on the peak near the endpoint of the /3-spectrum |17| . 
For an a-particle with £'« = 1 MeV (£'e=70 keV) 
the limit is weaker. Measurements with low threshold (6 
fired PMTs, or « 20 keV) were performed with 3 tons of 
PXE. The dead time of the system with this low threshold 
was 43%. At the energy 70 keV, the number of counts in 
the /3-spectrum in the interval 2aE is (6.6±0.2)-10"' d^^, 
where error of about 3% includes both systematic and 
statistic effects IMI- For values S'Hm=3.3-10'^, £a_b=0.68. 



iVAr=l-35-1029 and T= 2.74-10- 



one can obtain 



t{^'^C -^^ Be + a)> 6.1 • lO^^ y (90% c.l.). (16) 



4.4 Limits on non-Paulian transitions in ^^C and ^O 
with neutron emission: ^^C -^^^ C + n , ^^O -^^^ O + n. 

The energy released in the decay ^^C^^^ C -I- n is equal 
to the difference of the binding energies of ^^C and ^^C: 



tC^C ->^^ B+p)>5.0- W y (90% c.l). 



(14) 



QC'C 



11 



C- 



^EbC^C) + EbC^C). 



(17) 
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The binding energy of non-Paulian nuclei ^^C can be de- 
fined as EtC^C) ~ S6("C) + £;„,p(5i/2," C)-5„,p("C). 
The nucleus ^^C is unstable, fts nucleon separation ener- 
gies are S'„=13.1 and Sp — 8.7 MeV. If one assumes that 
the binding energies of the nucleons of ^^C on the S1/2 
shell are close to those of ^^C nuclei, then the energies 
released in the process (17) are Q = 6.5 and 4.5 MeV for 
the nuclei ^^Cp and ^^C„ in their final states, respectively. 
For decays in the water, the mean neutron energy defined 
in the analogous way is ~ 18 MeV. 

The resulting neutrons are thermalized in hydrogen- 
rich media (organic scintillator or water). The lifetime of 
neutrons in water and/or scintillator is the order of some 
hundreds of /j,s, after which they are captured by protons. 
The cross section for capture on a proton for a thermal 
neutron is 0.3 barns. The cross sections are much smaller 
for capture on the ^^O and ^^C nuclei: acC^G—3.5 mbarns 
and (Tc{^^O—0.2 mbarns. Capture of thermal neutrons n + 
p ^ d -|- 7 is followed by 7- emission with 2.2 MeV en- 
ergy. The background levels measured in CTF2 at this 
energy have been used to obtain an upper limit on the 
number of 7's with 2.2 MeV energy, and as a result, a 
limit on the probability of neutron production in the re- 
actions i^C^" C + n , 1^0^^^ O + n. Protons scattered 
during the thermalization with energies of some MeV can 
be registered by the detector, hence the sequential events 
were not cut out in the data selection. As a result, the 
main contribution to the background in the 2 MeV region 
was attributed to the decays ^^"'Bi— >^^^Po that were not 
suppressed by the delayed coincidence cut (see Fig. 4). 

The analysis was made under the assumption that the 
mean lifetime of the nucleons is the same in ^^C and 
""^^O nuclei, and that n-emission decays within both of 
them contribute to the experimental spectrum simulta- 
neously. The density of the PXE scintillator practically 
matches that of water. The density of nucleons that can 
cause the non-Paulian transitions with neutron emission 
is 2.7 X 10^3 cm-3 for PXE and 4.0 x 10^3 cm'^ for water. 
The response function for 10^ initial 7's generated in the 
liquid scintillator volume, and for 10^ 7's generated in the 
water layer of 100 cm, are shown in Fig. 4. The ratio of 
the volumes of PXE and water where the 7-events were 
simulated is 1 : 7; the difference in densities of hydrogen 
atoms capturing neutrons is small (5.1 x 10^^ cm^'^ for 
PXE and 6.7 x 10^^ cm~'^ for water); hence the response 
function in Fig. 4 corresponds to practically equal proba- 
bilities for the non-Paulian transitions for nucleons in ^^C 
and ^^O nuclei. The response function of the CTF2 to the 
7's of 2.2 MeV energy was obtained using the MC model. 
The shift in the positions of the peaks from 2.2 MeV to- 
ward lower energies is a result of the ionization quenching 
of Compton electrons with a low energy. 

The background in the 1.7-2.5 MeV region is a lin- 
ear function of energy (Fig. 4) . Because the peak position 
is well known, the maximum likelihood method was used 
to define the intensity of the peak corresponding to the 
2.2 MeV 7. Experimental background was modeled as a 
linear function plus the additional contributions of the re- 
sponse functions for 2.2 MeV 7 originating from the PXE 
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Fig. 4. Background energy spectra of the 4.2 ton Borexino 
CTF2 detector measured over 29.1 days: (1) with muon veto, 
radial cut (_R<100 cm) and a/P discrimination applied; (2) 
pairs of correlated events (with time interval Zii<8.2 ms be- 
tween signals) are removed; (3) the expected response func- 
tions of the detector for 7's with energy 2.2 MeV due to (n, p)- 
capture in the scintillator and (4) in the water. Corresponding 
mean lifetimes for the ^^C ^" C + n and ^'^O ^^'^ O + n 
decays are rum = 3.7 • 10^® y. In the inset the fitting function 
in the energy interval 1.7-2.5 MeV is shown. 



and water. The results of fitting are shown in the inset to 
Fig. 4. The minimum value of x^ = 83.9/90 corresponds 
to the total of 100 7 events inside LS. For the 90% confi- 
dence level, the corresponding limiting number of 7 orig- 
inating from the scintillator is 260. Taking into account 
the efficiency of the radial cut eu — 0.80, the total num- 
ber of captured neutrons in the CTF2 can be limited by 
N <2.7n/(d-t). This value is close to the expected rate of 
neutrons production by muons N «ln/(d-t) |38'. 

Finally, the limit on PEP violating transitions of nu- 
cleons in ^^C and ^^O nuclei with neutron emission is 



rC'CrO) -^'' C^O) +n)> 3.7 x 10'^ y (90% c.L). 

(18) 
This result is 6 orders of magnitude stronger than the one 
obtained through searching for neutron emission in Pb : 
T(Pb-> Pb + n)> 1.0- 10^0 y (68% c.l.) 0. 
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4.5 Limits on non-Paulian /3 transitions in ^^C: 
i2C^i2^ + e-+I7. 

The nucleus ^^N is unstable; it decays via ^^N— 
e^ ^ V with an energy release of Q = 17.3 MeV. The 
inverse process ^'^Q,^'^ 7V+e~+Fis possible if the binding 
energy of the non-Paulian nucleus Ei,{^'^N) is increased 
in comparison to the binding energy of the normal ^^N 
nucleus by a value exceeding Q. The energy released in 
the reaction ^^C— >^^ N + e^ +V is 



Q 



mp-m,-EbC'C)+EbC'N) 



(19) 



The value oi Eb{^^N) can be approximated by Eb{^^N) ~ 
i;b(i2^)+£;p(S'i/2, ^2 A^)-S'p(i2^). The separation energy 
of the proton in ^^N has a very low value, Sp{^'^N) = 0.6 
MeV. The value of Ep{Si/2,'^^ N) can be approximated by 
the mean value of the binding energies on the S1/2 shell for 
two neighboring nuclei: Ep{Si/2,^^l^) c^ 0.5iEp{Si/2,^'^G) + 
Ep{Si/2,^^0)) = 36.8 MeV. Hence, the expected value of 
Q is 18.9 MeV. 

The shape of the f3~ spectrum with end-point energy 
18.9 MeV is shown in Fig. 5. The limit on the proba- 
bility of this transition was based on the fact of observ- 
ing no events with E^ >4.5 MeV not accompanied by 
a muon veto signal. As noted above, it is necessary to 
take into account the probability rji^E^) of the muon veto 
triggering for the high energy events in scintillator. The 
obtained efficiency of detection of electrons with energies 
i;^ > 4.5 MeV is Z\£ = 0.31. The hmit on the lifetime of 
neutrons (A^„=4) in -'^^C with respect to the transitions 
violating the PEP is 

t{}^C ^1^ N + e- +V)>7.Q- 10^^ y (90% c.l.). (20) 

This result is 3 orders of magnitude stronger than the 
one obtained by NEMO-2, t(12c^12 iV -|- e~ + 17) > 3.1 • 
10^4 y (90% C.L) IT. 

The data available from the LSD detector |2H1 situated 
in the tunnel under Mont Blanc allows obtaining a qual- 
itative limit for this decay comparable to ours. In 15 , it 
is claimed that only 2 events were observed with energies 
higher than 12 MeV during 75 days of data taking with 
the detector loaded with 7.2 tonnes of scintillator, contain- 
ing 3 X 10^^ ^■^C nuclei. The upper limit that can be ob- 
tained using formula (8) with these data (with S'/im=5.91 
events for 90% c.l. and detection efficiency Ae = 0.23) is 
^(i2c_>i2 iV + e-+I7) > 9.5-1027y (90%c.l.). Wedidnot 
cite this approximate result in table 2, because the exact 
calculation requires precise knowledge of efficiency of the 
LSD detector. 
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Fig. 5. Probability of identification of an event with energy E 
in the scintillator by the muon veto ri{E) (1). The /3 spectra 
of ^^C — >^^ N -\- e~ +17^ without (2) and with (3) suppression 
by the muon veto are also shown in arbitrary units. In the 
inset, the r){E) function together with the experimental data 
taken with the radon source are presented. The tagged events 
of 2i*Bi-^^*Po at the energy _B=1.9 MeV are 'seen' by the 
muon veto system with an efficiency of 77(1.9 MeV) = 0.01. 



neutron in S'1/2- shell in ^^B nuclei is close to the experi- 
mentally found value for the nuclei ^^B: £'„(S'i/2j^^ B) ~ 
-B„(5i/2,"B) = 34.5 MeV. The end-point energy of the 
/S"*" spectrum is 16.8 VIeV, but the spectrum is shifted 
towards higher energies by ~ 0.8 MeV due to the register- 
ing of annihilation quanta. The efficiency of the ^^c^is 
B + e^ + V transition detection with energy release E > 
4.5 MeV is eae = 0.31. The lower limit on the lifetime of 
the proton in the ^^C nuclei is then 

t{^^C -^12 B + e+ + zy) > 7.7 • 10^^ y (90% c.l.) (21) 

The limits obtained by the NEMO collaboration for this 
reaction are 3 orders of magnitude weaker: t{^'^C -^^'^ 
B + e+ + v)>2.6- 10^4 y (90% c.l.) [TTl. 

The final results for different PEP violation transitions 
are shown in table 2 in comparison with previous results. 



4.6 Limits on non-Paulian /?+transitions in ^"^C: 
i2C^i2^ + e+ + j.. 

The energy release for this reaction, Q — 17.8 MeV, was 



5 Conclusions 

Using the unique features of the Borexino Counting Test 
Facility - the extremely low background, large scintilla- 
tor mass of 4.2 tonnes, carefully designed muon- veto sys- 



calculated by assuming that the binding energy of the tem and low energy threshold ~ new limits on non-Paulian 
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Table 2. Mean lifetime limits, rum (at 90% C.L.), for non- 14. 

Paulian transitions in the CTF2. Eo is the average energy of 15. 
particles, or end-point energy in the case of /3 -transitions; AE 

is the energy window of CTF2 in which decays were searched 16. 

for; eas is the detection efficiency; Sum the excluded number 17. 
of events in the CTF2 spectrum. 
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(2002) 29 



Channel 


Eo, 


AE 


£ae 


Jlim 


Tlim (y) 


Previous 




(MeV) 


(MeV) 






90% c.l. 


limits 


12^^12 C + 7 


17.5 


> 4.5 


4.3-10"^ 


2.44 


2.1-102^ 


4.2-10^'* [TTl 


i''0^'''0 + 7 


21.8 


> 4.5 


5.6-10-3 


2.44 


2.1-10^'' 


2.7-10^^ nni 


i2c^"B+P 


4.8-8.2 


2.0-4.7 


0.68 X 0.8 


130 


5.0-10^^ 


1.7-10^'^ [T^ 


^"C("0)^"C('50)+n 


2.2 


1.7-2.5 


0.8 


260 


3.7-102« 


1.0-10^° PI 


^''C^^'Be + a 


2.0 


0.07-0.23 


0.68 


3300 


6.1-10^3 


- 


i^C-^^^N + e'+T77 


18.9 


> 4.5 


0.31 


2.44 


7.6-10^^ 


3.110^* [TT1 


i^C ^^2 B + e+ + u, 


17.8 


> 4.5 


0.31 


2.44 


7.7-102^ 


2.6-10^^ [TT1 



transitions of nuclcons from the P-shell to the lS'i/2-shell 
in ^^C and ^^O with the emission of 7, n,p, a and f3^ par- 
ticles have been obtained: 
r(i2c^i2c; + -^)>2.1.1027y, 
r(WQ^i6q + j) > 2.1- 1027 y, 
^(i2c^ii B+p)> 5.0 • 10^6 y, 
r(i2c(i60^-^" C(i50) + n)> 3.7 • lO^^ y, 
Be + a)> 6.1- 10^3 y, 

- + iy)> 7.6 • 10^7 



.12 



N- 



y 



B + e+ +V)>7.7- 10^7 y, all with 90% C.L. 



r(i2C- 
r(i2C- 
and 
r(i2c 

Comparing these values with the data of table 2, one 
can see that these limits for non-Paulian transitions in '^^C 
with 7-, p-, n-, a-, and /9 - emissions are the best to date. 
The limits on the (3^ non-Paulian transitions in ^^C are 
comparable to those that can be obtained with the data 
of the LSD detector ^EljISni and the limit on non-Paulian 
transition in ^^O with 7 emission is comparable to the 
result obtained using Kamiokande data jlO| . 
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